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(57) Abstract 



An apparatus for, and method of, improving the resolution of a conventional imaging system (32) by effectively increasing the 
bandwidth of an imaging system's transfer function. An object is first illuminated with periodic illumination. The phase of the periodic 
illumination is varied while the periodic illumination is used to scan the object. A plurality of images are received by an imaging system 
whereby the images received correspond to variations in the phase of the periodic illumination. These images are subsequently processed 
(28) to extract information in phase with the periodic illumination and information 90 degrees out of phase with the illumination. 
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IMAGING MEASUREMENT SYSTEM 

FIELD AND PACKGROUND OF THE INVENTION 

The present invention relates to a system for enhancing the 
resolution of imaging systems by using a periodic pattern illumination. 
5 Conventional imaging systems today, are characterized by a finite 

and limited optical system bandwidth. This limitation manifests itself in 
an optical system's optical transfer function (OTF). The transfer function 
of most imaging systems, including optical and electronic microscopes, 
characterizes a system by relating the spatial frequencies of an observed 

10 object or target, to those frequencies of contained in a formed image. 
Many times, however, the resolution of such conventional imaging systems 
is not sufficient. In order to improve the resolution of an imaging system, 
it is necessary to extend the bandwidth of its transfer function. Increasing 
the bandwidth of the transfer function allows higher frequencies to be 

15 transmitted to the image. Several optical scanning systems have already 
been developed for just this purpose, such as the Confocal Microscope and 
the Near Field Microscope. 

A transform space scanning imaging apparatus and method are 
disclosed in U.S. Patent No. 4,929,951. The invention utilizes a different 

20 technique of generating a synthetic image from that of the present 
invention. The invention disclosed by the '951 patent utilizes a non- 
imaging receiver rather than a basic conventional imaging system. In 
addition, the invention fails to synthesize the transfer function of the 
object. 

25 SUMMARY OF THE INVENTION 

The present invention overcomes the limitations of the prior art by 
providing an imaging system that illuminates an object with periodic 
illumination whose phase characteristics are varied in a uniform and 
consistent manner. The scattered illumination is received by an imaging 
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device and processed to create a synthetic image. The processed synthetic 
image has a new transfer function that has an enhanced high frequency 
response. 

The present invention discloses an imaging system which transforms 
5 information from an object plane to a synthetic image plane with an 
improved transfer function. The information at the object plane is 
considered to be a multiplication of the illumination function with the 
target (i.e. object) function, which may be transmission, reflection or any 
other physical function which defines the interaction of the target with the 

10 illumination. Thus, the information at the object plane is actually created 
by the mixing of the illumination and the target information. Therefore, 
certain spatial frequencies observed at the image plane, may represent 
different frequencies of the observed target. Considering this interaction 
of illumination and. target, the object of the present invention is to provide 

15 an apparatus for and method of improving the transmission of certain 
bands of frequencies of the target through an imaging system by choosing 
a suitable illumination function and suitable image processing. 

The simplest case is to use a sine function as the illumination 
function. The mixing of the target with this illumination is a simple shift 

20 of the target frequencies by the illumination frequency. It is also possible 
that a periodic pattern consisting of several harmonics added together be 
used. The information carried by each harmonic can be readily identified. 
In the case of optical imaging, the periodic pattern may be created by 
imaging an optical grating and projecting the image upon the target. 

25 In addition, phase information can be extracted. Typically, the 

phase of a real function may be determined by adding an imaginary pan 
using the Hilbert transform. In the case of harmonic or periodic 
illumination, the phase of an image relative to the phase of the illumination 
can be measured. The information which is in phase with the illumination 
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yields the real part, of the image. and the information which is 90 degrees 
out of phase will yield the imaginary part. 

Hence, there is provided according to the teachings of the present 
invention, a method of improving the resolution of imaging systems, for 
5 imaging an object, comprising the steps of illuminating the object with a 
periodic pattern, scanning the object with the periodic pattern whereby the 
phase of the periodic pattern is varied, receiving a plurality of images, 
representing , the periodic pattern scattered off the object, the images 
corresponding to variations in the phase of the periodic pattern, producing 

10 synthetic images by processing the plurality of images to extract 
information in phase with the periodic pattern and information 90 degrees 
out of phase with the periodic pattern. 

There is also provided, according to the teachings of the present 
invention,- an apparatus for enhancing the resolution of an imaging system, 

15 for imaging an object, comprising, an energy source, periodic means for 
producing an illuminating periodic pattern in one dimension from the 
energy, the periodic means movable in one dimension whereby the phase 
...of the periodic pattern may be varied in one dimension, first imaging 
means for passing the periodic pattern from the periodic means through to 

20 the object whereby the object scatters the periodic pattern, second imaging 
means coupled, to the first imaging means, the second imaging means for 
converting the^ scattered energy into an electrical signal, the electrical 
signal representing images of the scattered energy, processing means 
coupled to the periodic means and the imaging means, the processing 

25 means for controlling the periodic means in one dimension, the processing 
means for extracting information in phase with the periodic pattern and 
information 90 degrees out of phase with the periodic pattern. 
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BRIEF DESCRIPTION OF THE DRAWINGS 

The invention is herein described, by way of example only, with 
reference to the accompanying drawings, wherein: 

FIG. 1 is a high level block diagram of a preferred embodiment of 
5 the present invention; 

FIG. 2 is a detailed. block diagram of a .preferred embodiment of the 
present invention; 

FIG. 3 A is a diagram of the optical transfer function of the basic 
imaging system; 

10 FIG. 3B is a diagram of the- transfer function of the synthetic 

image, S,; • ■ 

FIG. 3C is a diagram of the transfer function of the synthetic 
image, S : ; and, 

FIG. 4 illustrates an optical imaging measurement system. 

15 DESCRIPTION OF THE PREFERRED EMBODIMENT 

The present invention discloses an apparatus for and method of 
extending the bandwidth of a conventional imaging system by illuminating 
an object with periodic illumination, varying the phase of the illumination 
- and processing the received scattered images to extract amplitude and 
20 phase data. 

The principles and operation of the present invention may be better 
understood with reference to the drawings and the accompanying 
description. 

The present invention describes a system 10 of enhancing the 
25 measuring capability of imaging systems. The basic concept behind the 
present invention, as described above, is to scan an object with periodic 
illumination, vary the phase of the periodic illumination and capture the 
scattered image. The received data is processed to produce synthetic 
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images. Amplitude and phase information is. then extracted about the 
object. 

As ' shown In Figure 1, ah object 22 is first scanned with periodic 
illumination. "Object 22- scatters the illumination falling on it. Imaging 

5 means including a conventional imaging system 32 receives the scattered 
light image and converts it into- electrical signals. A processor 28 
performs image processing functions on the received data and forms a 
cbmplex synthetic image whereby the amplitude and phase information 
about can be determined. This data is then processed further depending 

10 on the particular application and/or displayed on a screen. The functions 
(i.e. control, image processing, etc.) that processor 28 performs may be 
realized by more' than one actual processor. Many processors many be 
utilized to better distribute the tasks system 10 must perform. Similarly, 
imaging system 32 may include one or more subimaging systems whereby' 

15 each subimaging system'contributes to a portion of imaging system 32. 
.. . There .exist alternative ways to scan an object by periodic 
illumination. If coherent light is used to illuminate the object, it is 
possible to create an illumination pattern using the interference of two or 
more coherent light beams. The scanning affect is achieved by shifting the 

20 phase'of the beams. If incoherent light is used to illuminate the object, it 
is possible to create an illumination pattern using a moving grating, whose 
image is projected onto the' object or target. The grating is movable in 
one or more dimensions. It also possible to illuminate the object with 
partially coherent light. Partially coherent light is neither purely coherent 

25 or purely incoherent but somewhere in between. Scanning of the object 
may be performed in one or more dimensions. 

The mathematical procedures and processes involved in generating 
synthetic images are presented below. First, the case involving one 
dimension is described followed by the case involving two dimensions. 
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The object is illuminated with energy, amplitude or any other 
physical quality that is significant to the measurement, having a space 
distribution L(t,x), which is a good approximation at the range of interest: 

(1) L(t,x) = Ao + A^osaTrx/S' + wt + 0,) + A 2 cos(4ttx/5 + 
5 2cjt + ... 

L(t,x) is a periodic function in x, with period equal to 5. The function in 
Eq. (1) is written as a series of harmonics having spatial frequencies 0, 
1/5, 2/5, 3/5 .... A scanning process is carried out by either sequentially 
or continuously by varying the phase Tot of the illumination. The constant 

10 phase is the phase of the illumination at t = 0 and x = 0. In the 

following description, are ignored without any loss of generality, 

in order to shorten otherwise very long equations. Ao, A M are 
constants in time and in the x-axis. In the general case, they may vary in 
the y-axis. In this case, L, the illumination distribution in equation (1) 

15 will also be a function of y\ the second spatial axis, so that L = L(x,y,t). 
A special case in which L is also periodic in the y-axis will be discussed 
in a later section. 

An alternative to continuous scanning is scanning using sequences 
of energy illumination whereby the phase changes in uniform discrete steps 

20 from one sequence to another. The illumination function, L n (x), in this 
case is given by: 

(2) L n (x) = Ao + A,cos(2ttx/5 + 2n?r/N) + A 2 cos(4ttx/5 + 
4nn/N) + ... 

Where n = 1, 2, 3 ... and N is an integer. 
25 The result of illuminating the object with a periodic pattern, as 

described by L(t,x) in Eq. (1), is an image which is continuously changing 
with time. 

The image will have the form of I(t,x,y) given by: 

(3) I(t,x,y) = B 0 (x,y) + B 1 (x,y)cos(o;t + $ x ) + B 2 (x,y)cos(2wt 
30 + 0 2 ) + ... 
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If the object is illuminated with sequential energy illumination scanning 
L n (x), as described in Eq. (2), conventional imaging system 32 will 
produce, a sequence of images having the form of I„(x,y) given by: 

(4) I n (x,y) = B 0 (x,y) + B t (x,y)cos(2n7r/N + <f> x ) + 
5 B 2 (x,y)cos(4n7r/N + <t> 2 ) + ... 

At this point, a pair of. synthetic images, S^x.y) and S 2 (x,y), are defined 
for each harmonic Z) , 25) , ... , ka> . The definition for the k'th harmonic is 
as given by:- 

. . (5) B k (x,y)cos(kcjt + 4>^ = S.,(x,y)cos(2k7rx/5 + kut) + 
10 . . S 2 (x r y)sinf2k7rx/5 + kwt) 

Since cos(2k7rx/<5 + kwf) and sin(2k7rx/5 + kajt) are orthogonal functions, 
.S, and S 2 are unique and well defmed for any desired harmonic, k, as 
described in.Eq..(5). In the case of sequential illumination of the object, 
the definition of S,(x,y) and S 2 (x,y) is given by the following equation: 
15 . (6) B k (x,y)cos(2kn7r/N + 0 k ) = S 1 (x,y)cos(2k7rx/o + 2n7r/N) + 
S 2 (x,y)sin(2k7rx/5 + 2n7r/N) 
It is important that N be large enough to avoid aliasing. The complex 
synthetic image S is defined by the following: 
(7) . S(x,y) = S t (x,y) + iS 2 (x,y) 
20 Where r = -1. 

Imaging system 10 processes and analyzes S t and S 2 (i.e. the 
complex synthetic image S) for a chosen k. This analysis is equivalent to 
finding the amplitude and phase of the Fourier transform of the received 
image, or. equivalent to finding the sine and cosine transformations of 
25 I(t,x,y) at the single frequency kS). 

S t is produced by extracting the information in phase with the 
illuminating pattern, while S 2 is produced by extracting the information 90 
degrees out of phase with the illuminating pattern. 
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The synthetic image, S, in (7), is "built up" from the linear 
combination of S ( and S 2 . For the purpose of understanding the previous 
equations, S may be considered to be a vector in the complex plane, and 
S { and S 2 may be considered to be the complex components of S. Thus, 
5 Si and S 2 may be thought of, respectively, as the projections of S on the 
real and imaginary axes of a complex plane. 

Going back to (1), the object is illuminated by L(t,x), which is a 
periodic function, represented as a cosine series. Illumination of the image 
results in an "output" represented by the cosine series given in (3) for 

10 I(t,x,y). This is a function of time at angular frequency, where constant 
angular frequency represents a constant scanning rate. In (3), angular 
frequency, u ? is the. same for each harmonic frequency (inverse time) 
component of the series representation of I(t,x,y), while phase, 0, is 
different . for each harmonic frequency component. Each harmonic 

15 component is represented by a pair of amplitude, B n , and phase, 0 n , 
values. Thus, (3) is a polar representation of I(t,x,y). In (5), the cosine 
series representation of I(t,x,y) is equivalently rewritten as the sum of a 
cosine and a sine series with constant phase. In (5), I(t,x,y) is represented 
in rectangular form, since cosine and sine are orthogonal functions, at an 

20 angle of 907degrees. Thus the coefficients of the cosine and the sine 
harmonic series are orthogonal components of I(t,x,y). Equation (5) gives 
the definition of the S^xj) and S 2 (x,y).as the coefficients of the cosine 
and sine components, respectively, of the B n of (3). Thus, S 1 is the real 
part, and S 2 is the imaginary part of synthetic image S(x,y) defmed in (7). 

25 The two components Si and S 2 are obtained. by mathematically analyzing 
an "optical image" to obtain its in-phase and 90-degrees out-of-phase 
components, respectively, as will be discussed further later. Various 
synthetic images may be produced mathematical processing which may 
include one or more components obtained from the optical image. 
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For scanning in both thex and y axis, the" definition is similar to the 
one axis case." For two axis, the illumination function is given by the 



approximation: 



(8) L mn (x,y) 



Ao + A,cos(2tx/5 x 4- 27rm/M)cos(27ry/o y + 



5 



27rn/N)- 



+ A 2 cos(47rx/<5, + 47rm/M)cos(27ry/6 y + Ittu/N) 
+ A 3 cos(2xx/5, + 27rm/M)cos(47ry/5 y 4- 47rn/N) 
+ A 4 cos(4ttx/5 x + 47rm/M)cos(47ry/5 y + 47rn/N) 



+■ ... 



10 Where n, m = 1, 2, ... . 

A set of illuminations L mn (x,y), m = 1 ... M and n = 1 ... N, will result 
in a set of images I mn (x,y). Synthetic images S 1? S 2 , S 3 and S 4 are defined, 
which best fit I mn (x,y), in the following equation: 

(9) I mn (x,y) = S l (x,y)cos(27rx/5, + 27rm/M)'cos(27ry/5 y + 2irn/N) 

15 • ■ ' S : (x,y)sin(27rx/5 X + 27rm/M)sin(27ry/5 y + 2ttii/N) 



Where m = 1 ... M, n = 1 ... N, Constant is a constant and Residue is 
20 orthogonal residue of other harmonics of 1/5 X or l/5 y ; and 1/M or 1/N. 

An example of a system that embodies the mathematical procedures 
and processing to extend the bandwidth of a conventional imaging system 
is illustrated in Figure 2. Shown in Figure 2 is a detailed block diagram 
1 of system 10.' An energy source or light source 12 provides any type of 
25 electromagnetic radiation or energy such as. coherent, incoherent or 
partially coherent light, microwave, infrared, ultraviolet, x-ray, radio, 
ultrasonic, etc. Energy from light source 12 passes through periodic 
means 14, which may be one grating for scanning in one dimension or two 
gratings for scanning in two dimensions, which is attached to motor 26. 



+ S 3 (x,y)cos(27rx/5 x + 27rm/M)sin(27ry/5 y + lirn/N) 
'+ S 4 (x",y)sin(2irx/5 X + 27rm/M)cos(27ry/S y + 27rn/N) 
+ Constant + Residue 
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Motor 26 can move grating 14 either in discrete steps or continuously and 
in one or more dimensions. Energy then passes through grating 14 
through grating lens 16. Following grating lens 16, the energy passes 
through beam splitter 18. The energy then passes through object lens 20. 

5 The energy then illuminates object 22 and is scattered -by it. During the 
process of scattering of the illuminating energy by object 22, the energy, 
in reality, is actually heterodyned with the object. The scattered energy 
is reflected 90 degrees by beam splitter 18 so as to pass through camera 
lens 26 and into camera 30. Camera 30 receives the image of the 

10 illumination scattered by object 22. Camera 30 converts the optical 
information received into electrical information -suitable for processing by 
electronic processing means 28. One of the possible outputs from 
processor 28 is a display 36 showing a synthetic image of object 22. 

In the example, energy (i.e. incoherent light) is used to illuminate 

15 object 22, however, coherent or partially coherent light could also be used 
with similar results. The. example also involves scanning only in one 
dimension to simplify the mathematics. However, the example could 
easily be extended to two dimensions using the same line of analysis. 

Object 22 is illuminated with intensity distribution L(t,x) as defined 

20 by Eq. (1). It is assumed that the scattering of light from the object is 
linear with the intensity of the illumination. The intensity of light 
scattered by the object is I^x) which is given by: 
(10) I|(t,x) = C r(x)cos(-27rx/<5 + wt) + Res. 
Where: 

25 r(x) = object scattering function 

Res. = higher harmonics of co and direct current (DC) 
C = constant 

In Eq. (10), r(x) is the scattering, reflection, transmission or any other 
physical function which defines the interactions of object 22 with the 
30 illuminating light. If conventional imaging system 32, in Figure 1, is 
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'incoherent,, having a transfer function T 0 (fJ where f x is the spatial 
frequency in the x-axis; The following theorems (a) and (b) will be shown 
to be true: - 

(a) ; The synthetic image. S 1? processed by system 10, as defmed by Eq. 
5 (5), is a linear transformation of r(x) having a transfer function T^fJ, as 
given by: 

(11) . T^) = C{T 0 (f x - 1/5) + T 0 (f x 4- 1/5)} 

Where C is a constant. S, represents image information in phase with the 
illumination. 

10 (b) The synthetic image S 2 , processed by system 10, as defmed by Eq. 
(5) is a linear transformation of r 2 (x) having a transfer function T 2 (f x ), as 
given by: . 

(12) T 2 (fj = C{T 0 (f x - 1/5) - T 0 (f x + 1/5)} 

Where r 2 (x) is the Hilbert transform of r(x). S 2 represents information 90 

15 degrees out of phase with the illumination. 

The transfer functions T, and T 2 are shown in Figures 3B and 3C 
for the classical incoherent diffraction limited optical transfer function T 0 
shown in Figure 3A. The cutoff frequency of transfer functions T { and T 2 
is f G + f 0XF . As is apparent from Figures 3A to 3C T the bandwidth of the 

20 synthetic images has been extended by f G or 1/5. It is important to note 
that while conventional imaging system 32 acts as a low pass filter at zero 
frequency, system 10 acts as a bandpass filter at the frequency of grating 
14, f G . To better understand this phenomenon, assume information about 
object 22 exists at a certain frequency f 0 and that f 0 > f OTF . When object 

25 22 is heterodyned or mixed with the periodic energy illumination, this 
frequency f 0 will be shifted up and down by frequency f G . If one of the 
shifted frequencies, for example f 0 - f G , is in the bandwidth of f 0TF , it will 
pass through optical imaging system 10 at this frequency. The processing 
performed by processor 28 shifts the information back to the original 

30 frequency f 0 . 
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To better understand the previous example, the following proof is 
presented. The following three trigonometric equations are required for 
this proof: 

(13) cos(a + |8) = cos(a)cos(/3) - sin(a)sin03) 
5 (14) sin(a + &) = cos(a)sin(/3) + cos(/3)sin(a) 

(15) cos(a)cos(j3) = l/2[cos(a + 0) + cos(a - &)] 
Let R(f x ) and 0(f x ) be the amplitude and phase of the Fourier transform of 
r(x) (the object scattering function) in the x-axis so r(x) in Eq. (10) takes 
the form of: 

10 (16) r(x) = / fx R(Qcos(27rf x x + 4>(f x ))df x 

Giving: . •. . 

(17) I,(t,x) = c/ fx R(f x )cos(27rf x x + 0(f x ))cos(-2irx/5 + ut)df x + 
Res. 

Using Eq. (15) yields: 
15 (18) I,(t,x) = cX x R(f x )cos(2*(f x - l/5)x + <t>(Q + cot)df x 

+ C 1 / fx R(f x )cos(27r(f x + l/5)x + 0(f x ) - wt)df x 
+ Res. 

The intensity of the image,, assuming incoherent imaging is given by: 

(19) L(t,x) = c/ fx T 0 (f x - l/5)R(f x )cos(2x(f x - l/6)x.+. <fi(Q + ut)df x 
20 + C,J fc T 0 (f x + l/5)R(f x )cos(27r(f x + l/5)x + <p(f x ) - wt)df x 

+ Res. 
Using Eq. (13) yields: 

(20) I,(t,x) = c/ fx T 0 (f x - l/5)R(f x )[cos(27rf x x + 0(f x ))cos(-27rx/5 + ut) 

- si n(2 rf ,x + *(f,»s,n(.2,x« + 
25 + Cj f J 0 (f x + l/6)R(f x )[cos(27rf x x + 0(f x ))cos(2^x/5 + tot) 

-sin(2xf x x + <^(f x ))sin(27rx/6 - cot)]df x 
+ Res. 

Collecting all terms that multiply cos(-27rx/S + ojt) = cos(2irx/5 - ut) and 
all terms that multiply sin(-27rx/5 + cot) = -sin(27rx/o - ot) yields: 
30 (21) I 2 (t,x) = Qcos^Trx/S+wt) 
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fx {T 0 (f, - 1/5) + To(f x -f l/5)}R(f x )cos(2Trf x x + 0(f x ))df x 
+ Gjsin(27rx/5 +' wt) 

* / ft {T 0 (f x - 1/5) - T 0 (f x + U5)}R(fjsm(2icf x x + 0(f x ))df x 
+ Res. - . 

5 The synthetic images S,(x) and S 2 (x) derived from I 2 (t,x), as defined by 
Eq; (5), are given by: 

(22) • S I (x) = C l / fx {T 0 (f x - 1/5) + T 0 (f x +' l/5)}R(fJcos(27rf x x + 0(fj)df x 

(23) S 2 (x) = G l Jf X {T 0 (f,- 1/5) - T 0 (f x + l/5)}R(f x )sin(27rf x x + 0(f x ))df x 
The function r(x) is given by Eq. (16): 

10 (16)- r(x) = / ft R(f x )cos(2?rf x x + 0(f x ))df x 

The function r 2 (x) is the Hilbert transform of r(x) and is given by: 

(24) r 2 (x> = l fx R(f x )sin(227rf ;c x + 0(f x ))df x 
Eqs. (22) and (23) thus prove theorems (a) and (b) presented above. 

Optical Microscope 
15 Described above is a novel imaging system which uses a periodic 

pattern of illumination in order to improve the resolution of the imaging 
system, As .will. now be described, the present invention deals with the 
methods of applying the technology to optical microscopes in order to 
extend their resolution capabilities, and to integrate three dimensional 
20 imaging capabilities in microscopy, which becomes possible by the use of 
periodic illumination. 

In three dimensional capabilities we should consider: 
(a) the capability to image a thin slice within a thick volume, 
.(b) the capability to identify the three dimensional information 
25 within the thin slice, 

(c) the capability to create a three dimensional image of a thick 
volume by .the integration of information related to several 
thin slices, and 



WO 97/06509 , PCT/US96/12276 

14 

(d) the capability to focus on those slices where there is 

information and to ignore other slices. 
The standard light microscope can not identify the three dimensional 
information in a thin or thick volume. In the case of a thick volume, the 
5 information at different slices in the volume may overlap so the 
microscope will not be able to create a sharp image of any slice. 

The prior art Confocal Microscope was developed to answer these 
limitations. The Confocal microscope illuminates the target with a beam 
focused to a small area. To create an image of the whole field of view, 
10 the object is scanned with the beam. The Confocal Microscope can create 
a sharp image of a thin slice which is in the focal plane of the beam, with 
other slices not affecting the image. Three dimensional imaging of the 
thick volume is possible by imaging a sequence of thin slices. 

The present invention discloses a new method for three dimensional 
15 imaging, based on periodic illumination. Compared with the Confocal 
Microscope, the present invention has the advantage of three dimensional 
imaging capability within a thin slice , and the advantage of improved 
lateral resolution as shown above in the previous discussion in this 
application. As with the confocal microscope, three dimensional imaging 
20 of the thick volume is possible by imaging a sequence of thin slices. 

Description of the optical microscope of the present invention: 

A method of imaging by optical microscope using a periodic 
illumination, will include three major steps: 

(1) Illumination the observed object by a periodic pattern of 

25 light, 

(2) Imaging of the object to a camera or detector to create 
a signal related to the object, and 

(3) Mathematically processing of the signal to create 
synthetic images of the object. 
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Definitions: 

Illumination: The light illuminating the object may be ultraviolet, 
visible, infrared or any other electromagnetic wave. The illuminating 
pattern at the object plane may be periodic in one or two axes. We 
5 consider two important ways to create a periodic pattern of illumination: 

(!) The pattern may be created by two or more coherent beams 
which interfere with one another. In this case, the illumination pattern is 
also the interference pattern. The phase of the pattern is changeable by 
controlling the phase of the beams. 
10 (2) The periodic illumination pattern may be an image of another 

pattern (source pattern), which has a periodic structure. In this case, the" 
illumination is enabled by projecting the image of the source periodic 
pattern on the observed object. 

The phase of the illumination pattern may be controlled by 
15 physically moving the source pattern. 

Alternatively, the pattern itself is controlled electrically. Such 
devices may be divided into two groups: 

(1) The electrically controlled spatial filter is an optical filter whose 
transmission, reflection or other optical property are controllable at each 

20 point of the filter in space. Such devices exist today, using the 
polarization properties of liquid crystals, such as are widely used as flat 
panel displays. 

(2) The electrically controlled light source is a source of light for 
which the intensity emitted by each point in a certain space is controllable. 

25 An example of such device is the Cathode Ray Tube (CRT) which is 
widely used in computer monitors. 

Imaging: The imaging system is an optical microscope, which 
collects light resulting from the interaction of the illuminating pattern with 
the object, to create a magnified optical image of the object. This 
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magnified optical image of the object may be observed by the eyes or by 
a detector which transforms the optical, image : into an electrical signal. 
The imaging system and the optical illumination system which produces 
the periodic illumination pattern may share the same objective and other 
5 optical components. Alternatively, these may be two different systems of 
objectives and optical components "coupled" by the fact that the image 
plane of one system coincides with the object plane of the other system. 
Useful information of the object may be obtained from the image only if 
there is some physical interaction between the light of the illumination and 

10 the object. According to the optical configuration of the imaging system 
and according to the optical properties of 'the object,, we may consider 
several such interactions. The interaction may be reflection, transmission, 
absorption, scattering, phase shifting, fluorescence, depolarization or any 
other physical interaction of light and matter. 

15 Processing: The mathematical processing for the creation of one or 

several synthetic images is a mathematical analysis over a single optical 
image or over a sequence of optical images which are created while 
changing the phase of the illuminating pattern. The synthetic image is a 
mathematical function related to the object as an image, unlike the optical 

20 image which represents a physical quality like the intensity of. light at the 
image plane. In the preceding .discussion, a useful set of synthetic images 
where analyzed by extracting information at the image plane. Information 
is extracted which is in phase with the phase of the illumination pattern, 
and information is extracted which 90 degrees out of phase relative to the 

25 phase of illumination pattern. These information components are used in 
the creation of the mathematical synthetic image. As will.be explained in 
the following sections, there are other useful images that may be created 
by extracting the amplitude and phase of the optical image. 
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: Three dimensional imaging: • The periodic illumination scanning in 
one axis, is a process in which the object is illuminated with energy, or 
amplitude, or other physical, quality that is significant to the measurement, 
having a space distribution function at the focal plane L(x,t) which is a 
5 good approximation at the range of interest to: 

(25) L(x,t> = Ao + A, cos ( 2ttx/5 + yf,(t) ) 
' \ .+ A 2 cos ( 4ttx/5 4- 2^(t) ) + ... 
L(x,t) is a periodic function, with period equal to 5. The axis x coincides 
with the periodic axis of L. The function in L in equation (25) is written 
.10 as a series of harmonics with spatial frequencies 0, 1/5, 2/5, 3/5, .... The 
scanning- is enabled by changing the phase ^(t) . 

We will consider the illumination pattern to be tilted, if within the 
depth of focus, the space distribution function L(x,z,t) is a good 
approximation in the range of interest to: 
15 *(26) L(x,z,t) = Ao +A l cos ( 2ttx/5 + ^(t) + az ) + ... 

where a is constant, and z = 0 at the focal plane. If a =0, we will consider 
the illumination pattern to be non-tilted. A, may also be a function of y or 
z, because the z-axis measures the distance from the focal plane, where the 
modulation is greatest. A drop in the modulation will cause A^ to 
20 increase, while all the other coefficients will decrease. 

A point of the object at location (x,y,z) within the focal depth of the 
imaging system, will be illuminated by a periodic pattern with a phase 
dependent on its x and z. Knowing the (x,y) location of the point, for 
example, * by observing the two dimensional image of the object, it is 
25 possible to analyze the height of the point on z-axis by extracting the phase 
az. . 

Measurement of the phase az in (26) can be done qualitatively by 
observation of the lines of illumination in a static mode, where L(x,z) is 
time-independent. The lines will create a meshing over the object, the 
30 shape of the meshing effect being a function of the topology of the object. 
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A more accurate measure is enabled by shifting the phase \f/(i). For 
example, we may consider a. constant rate of phase shift, cj, so equation 
(26) will have the form of: 

(27) L(x,z,t). = Ao + A { cos ( 2ttx/5 + ot + az )" + ... 

5 The image of the object illuminated by such a pattern will have the form 
of: • • 

(28) I(x,y,t)= B 0 (x,y) +'B 1 (x,y) cos ( 2irx/d + cot + az + <£(x,y) 

) + ... 

In equation (28), the axes x,y are the equivalent axes to the axes x,y 
10 in the object plain, imaged to the image plane.. It is possible to evaluate 
both amplitude B^x.y) , and the phase [2ttx/o 4- az + <£(x,y)] at any 
desired point in (x,y) by means of Fourier transformation in time domain. 
The phase measured at the image plain contains the useful component, az, 
from which the height z may be measured, plus an additional phase <6(x,y), 
15 which limits the accuracy of the measurement of z. The additional phase 
<Kx,y) has a high value at high spatial frequencies, and a low value at low 
spatial frequencies. The third component in the evaluated phase is 2vrx/5. 
This component is known for a known point location x, and known period 
5. 

20 The Fourier time domain transformation does not necessarily 

require a constant rate of phase shifting, \p. It is possible to extract the 
same information through a sequence of images resulting from phase 
shifting in discrete steps. 

Thus, it is possible to evaluate three dimensional information of an object, 
25 by illuminating the object with a tilted periodic pattern, and creating 
synthetic images by measuring the phase and amplitude at the optical 
image plain. The images created by measuring phase and amplitude at the 
image plane, may also be useful for the non-tilted illumination pattern. 
For example, if the object contains a unique, adjacent point, which 
30 interacts with the illumination, the phase information which includes the 
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component 2.7rx/5 will yield the exact location of the point of interest on the 
x axis. The example given here is with illumination pattern periodic in 
one axis, x. The method can be used for an illumination pattern which is 
periodic in a different axis or which is periodic in two axes. 

5* The case. of the periodic illumination in two axes, x and y, is a 
simple continuation of the case of a periodic pattern in one axis, x. The 
same method' for three dimensional imaging using a periodic illumination 
pattern in a single axis, x, can be applied in both axes, x and y. 

The method of imaging an object using a periodic illumination 

10 pattern may yield information of a thin slice within a thick volume. Only 
the thin slice, which is in the depth of focus of the microscope and the 
optical system which produces the illumination pattern, can contribute to 
. the image. The three dimensional imaging of a thick volume is enabled 
by creating a. sequence of thin slice images. In the case of a non-tilted 

15 periodic illumination pattern, the vertical resolution is equal to the 
thickness of the slices, .A tilted illumination pattern may be used to 
provide a better vertical resolution. 

Automatic Focussing 

The periodic pattern illumination is also very useful for focussing 
20 the. optical system. The periodic illumination pattern is a uniform 
illumination modulated by a periodic pattern. The periodic pattern creates 
a modulation over the illuminated object with the spatial frequency of the 
basic period, of the pattern and its higher harmonics. If the observed 
object is in the focal plane of the microscope and the illumination, the 
25 optical image of the object will also appear to be modulated with the same 
spatial frequency. If the object is out of focus, modulation of the 
illumination will decrease. Therefore, measuring the amplitude of the 
modulation frequency over the. optical image can verify that there is an 
object within the focal range of the microscope and the illumination 
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system, and can help to optimize adjustment of the position of the focal 
plane for better imaging of the object. The focal range contains the object 
plane of the microscope and a certain range below and above the object 
plain, so that any object within that range may create a sharp optical image 
5 modulated by the periodic illumination pattern. The range of sharp optical 
image is the depth-of-field of the microscope. 

Fourier transformation of the optical image at a certain range of 
interest will yield the amplitude of the modulating spatial frequency. 
Depending on the optical configuration and , the interaction of the 

10 illumination with the object, high or low amplitude will indicate that the 
imaging system is in focus. If the optical image is created by light 
transmitted through the object, low amplitude of the modulating frequency 
will indicate that there is an interaction of the periodic illumination pattern 
with the object. If there is no interaction at the object plane, then the 

15 illumination pattern will be transmitted without any interference, therefore 
the amplitude of the modulation frequency will be high. In contrast, if the 
interaction of the periodic illumination pattern with the object is by 
reflection, then a high amplitude of the modulating frequency at the image 
plane will indicate that there is an object within the focal range which 

20 reflects some of the illumination. Other types of interactions, such as 
fluorescence, will also yield a high amplitude of the modulating frequency. 
.Therefore, it is possible to identify an interaction of the illumination with 
the object at the focal range of a microscope by illuminating an object with 
a periodic illumination pattern, and by measuring the amplitude of the 

25 modulating frequency at the area of interest on the optical image. 

It is also possible to optimize the focus of the imaging microscope 
by measuring the amplitude of the modulation frequency while varying the 
focal range of the microscope, then finding the range at which the 
interaction of illumination with the object is the greatest. Depending on 
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the type of interaction,* the highest or lowest amplitude of the modulation 
frequency will correspond to the greatest interaction. 

* Illumination of the object with a periodic illumination pattern 
creates spatial modulation with the basic frequency of the period. One 

5 may also create temporal modulation by varying the phase of the pattern. 
For example, if we illuminate an object with the periodic pattern of 
•equation (27), we may identify a spatial modulation with the spatial 
modulation frequency 1/5, and may also identify a temporal modulation 
with temporal modulation frequency ullir. Higher harmonics of these 

10 frequencies- may also modulate the optical image! Measurement of the 
modulation of the optical image can be done either in space domain or in 
time domain. In space domain, the modulation will be measured by 
analyzing ' the amplitude *of the spatial ■ modulating frequency in space 
domain at the area of interest of the optical image. The amplitude of the 

15 modulation at a certain frequency is obtained from the Fourier 
transformation of the optical image at that frequency. In time domain, the 
■ modulation will be 'measured by analyzing the amplitude of the temporal 
modulation frequency in time domain at any point or an area of the optical 
image. 

20" ' In equation (27), the phase of the periodic illumination pattern is 
* varied continuously at a constant rate u. The phase could also be varied 
in 'discrete steps rather than continuously. In certain cases, varying the 
phase from zero to 27r is rather complicated and a smaller range of phase 
variations is desired (for example, in the case that the phase is shifted by 

25 mechanically moving a source' pattern).* In that case, it is possible to vary 
the phase of the periodic illumination pattern harmonically at a certain 
frequency, f, in time. For a periodic illumination in one axis of equation 
(26), illumination with harmonic phase variation will have a space and 
time distribution function which is a good approximation at the range of 

30 interest to L(x,t): 
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(29) L(x,t) =; Ao + A^osC 2ttx/5 + a m cos( 2 xft ) ) + 
where f is. the phase modulation frequency in time domain. 

Assuming the phase variations are small, so that a m <<27r, the 
modulation in time domain may be measured by analyzing the amplitude 

5 of the phase modulation frequency, f, in time domain, at any point or area 
of the optical image. The amplitude of the phase modulation frequency, 
f, in time domain is defined by the Fourier transformation in time domain 
at the same frequency. The example given here is with illumination 
pattern periodic in one axis x. The method can be used for illumination 

10 pattern periodic in a different axis or periodic in two axes. 

The method of focussing the optical microscope using the periodic 
pattern illumination may also be used to couple the microscope to another 
optical imaging system. One way to produce the illumination pattern is by 
providing a source pattern and projecting its image on the object. The 

15 optical system that projects the illumination pattern on the object should 
be coupled to the optical microscope that produces the optical image, so 
the image plane of the first system (projection system) will coincide with 
the object plain of the other system (microscope). If the two systems do 
not share the same objective lens, then an adjustment will be required to 

20 couple them to together. For example, if the optical system which projects 
the illumination pattern is an optical microscope having its own 
microscope objective, then the coupling to the imaging microscope will be 
enabled by adjusting the distance between the two objectives. A method 
for coupling the two optical systems is provided by projecting a periodic 

25 illumination pattern with one system while imaging the pattern with the 
other, and adjusting the image plane of one system to the object plane of 
the other to produce the sharpest optical image. The sharpness of the 
optical image of the periodic pattern can be measured either by measuring 
the amplitude of the modulation frequency in time domain or by measuring 
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the amplitude of the modulation frequency ; in time domain. These 
measurements were part -of the focussing method explained before. 

• Implementation 

Construction of the physical hardware and provision of the software 
5 necessary to implement the method of the present invention, will be within 
the understanding and ability of skilled artisans in the field. A symbolic 
representation. of a physical optical microscope system, 40, according to 
the; present invention is shown in Figure 4. Periodic illumination, 41, is 
provided by any appropriate illumination source, as described above. For 

10 example, the combination of light source, 12, and grating, 14, of Figure 
2, with motor, 26, moving grating, 14, may be used. In the illustration 
. of Figure 4, the periodic illumination pattern is periodic in the x direction. 
The x, y, and z axes shown are orthogonal axes in three-space. The 
physical interaction of the periodic illumination with the object, 22, may 

15 be any of a wide variety of interactions. These include reflection, as 
shown for the purpose of illustration, in Figure 4. Imaging, 42, is 
provided by any appropriate imaging system, such as an optical 
.microscope with a photodetector device, to develop an electronic 
representation "optical image". The optical image provided by the 

20, imaging system is processed by any appropriate processor, such as an 
electronic digital . computer. Processing, 48, of the optical image, 
produces at least one synthetic image, 50. The synthetic images are the 
result of processing according to the methods of the present invention, 
using the unique combination of hardware, including periodic illumination, 

25 and software, called for by the method of the present invention. The 
processing, 48, consists of mathematically operating on the optical image 
to produce at least one synthetic image, 50. 
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While the invention has been described with respect to a limited 
number of embodiments, it will be appreciated that many variations, 
modifications and other applications of the invention may be made. For 
example, in the implementation of Figure 2,. lens, 20, may be a 
5 microscope objective, and lens,, 16,. may be a tube lens. It is possible that 
lenses 16 and 26 may be omitted, and a single lens or set of lenses, 20, 
will both project the illumination pattern and image the object. While 
lenses 16, 20, and 26, are illustrated as simple lenses, in general, they 
may represent complex lenses or lens. systems. 
10 . A tilted illumination pattern may be implemented by collimating the 
beam illuminating the grating, 14, and tilting the collimated beam with 
respect to the optical axis of the lenses, 16 and 20. If the collimated beam 
is parallel to the optical axis, then the illumination pattern will be non- 
tilted. 

15 While the invention has been described with respect to a limited 

number of embodiments, it will be appreciated that many variations, 
modifications and other applications of the invention may be made. 

While the above discussion of the present . invention is expressed in 
terms of a microscope, which is an optical imaging system which produces 

20 a magnified optical image of an object, the invention is not limited only 
to use with microscopes. Rather, the present invention applies to any 
optical imaging system for which the periodic pattern illumination can be 
used. 
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-WHAT IS CLAIMED IS: 

1. A method- of improving the resolution of imaging systems, 
for imaging an object, comprising the steps of: 

illuminating the object with a periodic pattern; 

scanning the object with said periodic pattern whereby the phase of 
said periodic pattern is varied; 

receiving a plurality of images, representing said periodic pattern 
illuminating the object, said images corresponding to 
variations in the phase of said periodic pattern; and, 

producing synthetic images by processing said plurality of images 
to extract information in phase with said periodic pattern and 
information 90 degrees out of phase' with said periodic 
pattern. 

2. A method of improving the resolution of imaging systems, 
for imaging an object, comprising the steps of: 

illuminating the object with a periodic pattern: 

scanning the object with said periodic pattern in one dimension 

whereby the phase of said periodic pattern is varied; 
receiving a plurality- of images, representing said periodic pattern 

illuminating the object, said images corresponding to 

variations in the phase of said periodic pattern; and, 
processing said plurality of images to extract synthetic images S t 

and S 2 . 

3. The method of claim 2, wherein the phase of said periodic 
pattern is varied continuously. 
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4. - The method of claim 2, wherein the phase of said periodic 
pattern is varied .is discrete steps. 

5. A method of improving the resolution of imaging systems, 
for imaging an object, comprising the steps of: - 

illuminating the object with a periodic pattern; 

scanning the object with said periodic pattern in one dimension 

whereby the phase of said periodic pattern is varied; 
receiving a plurality of images, representing said periodic pattern 

illuminating the object, said images corresponding to 

variations in the phase of said periodic pattern; and, 
producing at least one synthetic image by processing said plurality 

of images to extract at least one information selected from 

the group consisting of . . 

(a) information in phase with said periodic pattern and information 
90 degrees out of phase with said periodic pattern, 

(b) information exclusively in phase with said periodic pattern, and 

(c) information exclusively 90 degrees out of phase with said 
periodic pattern. 

6. A method of improving the resolution of imaging systems, 
for imaging an object, comprising the steps of: 

illuminating the object with a pattern periodic in two dimensions; 
scanning the object with said periodic pattern in two dimensions, 

whereby the phases of said periodic pattern are varied; 
receiving a plurality of images, representing said periodic pattern 

illuminating the object, said images corresponding to 

variations in the phases of said periodic pattern; and, 
processing said plurality of .images to extract synthetic images S lf 

S 2 , S 3 and S 4 . 
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7. ... A method of improving the resolution of imaging systems, 
for imaging an object, comprising the' steps of: 

illuminating the object with a pattern periodic in two dimensions, 

along an x-axis and a y-axis; 
scanning the object with said periodic pattern in two dimensions, 

whereby the x-axis and y-axis phases, of said periodic 

pattern are varied; 
receiving a plurality of images, representing said periodic pattern 

illuminating the object, said images corresponding to 
• variations in the phases of said periodic pattern; and, 
.producing at least one synthetic image by processing said plurality 

of images to extract at least one information selected from 

the group consisting of 

(a) information in phase with the x-axis illuminating pattern and in 
• phase with the y-axis illuminating pattern, 

(b) information 90 degrees out of phase with the x-axis illuminating 
pattern and 90 degrees out of phase with the y-axis illuminating pattern, 

(c) information in phase with the x-axis illuminating pattern and 90 
degrees out of phase with the y-axis illuminating pattern, and 

(d) information 90 degrees out of phase with the x-axis illuminating 
pattern and in phase with the y-axis illuminating pattern. 

8. An apparatus for enhancing the resolution of an imaging 
system, for imaging an object, comprising: 

. an energy source; 

.periodic means for producing an illuminating periodic pattern in 
one dimension from said energy, said periodic means 
. . movable in one dimension whereby the phase of said 
periodic pattern may be varied in one dimension; 
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first imaging system, for passing said periodic pattern from said 
periodic means through to the object .-whereby the object 
interacts with said periodic pattern; 

second imaging system coupled tc said first imaging means, said 
second imaging system for converting energy resulting from 
interaction between the object and said periodic pattern into 
an electrical signal, said electrical signal representing images 
of said energy resulting from interaction between the object 
and said periodic pattern; and, 

processor coupled to said periodic means and said second imaging 
system, said processor for controlling said periodic means in 
one dimension, said processor for extracting information in 
phase with said periodic pattern and information 90 degrees 
out of phase with said periodic pattern. 

9. The apparatus of claim 8, wherein said periodic means 
includes a grating. 

10. The apparatus of claim 8, wherein said processing means 
causes said periodic means to move continuously whereby the phase of the 
illuminating periodic pattern falling on the object is varied continuously. 

11. The apparatus of claim 8, wherein said processing means 
causes said periodic means to move in discrete steps whereby the phase of 
the illuminating periodic pattern falling on the object is varied in discrete 
steps. 

12. An apparatus for enhancing the resolution of an imaging 
system, for imaging an object, comprising: 

an energy source; 
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16. A -method, for producing a synthetic image of an object 
• comprising the steps of; 

(a) . illuminating the object .with a periodic illumination pattern 
whereby the object interacts with said periodic illumination pattern; 

(b) scanning the object with said periodic illumination pattern 
whereby the.phase of said periodic illumination pattern is varied; 

. . .(c) providing an optical microscope for imaging said interaction 
.of theobject with said periodic illumination pattern, said imaging thereby 
producing optical images, said optical images representing said interaction 
of the object with said periodic illumination pattern; 

(d) producing a plurality of said optical images with said optical 
microscope; 

(e) providing a processor for mathematically processing said 
optical images to produce a synthetic image; and, 

(f) processing said optical images with said processor to produce 
. a synthetic image. . 

17. The method of claim 16, wherein said periodic illumination 
pattern is tilted. 

18.. The method of claim 16, wherein said interaction of said 
periodic illumination pattern with the object is scattering. 

19. The method of claim 16, wherein said interaction of said 
periodic illumination pattern with the object is reflection. 

20. The method of claim 16, wherein said interaction of said 
periodic illumination pattern with the object is transmission. 
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periodic means for . producing an illuminating pattern periodic in 
two .dimensions from said energy, said periodic means 
movable in two dimensions whereby the phases of said 
periodic pattern may be varied in two dimensions; 

first imaging system for passing said periodic pattern from said 
periodic means through to the object whereby the object 
interacts with said periodic pattern; 

second imaging system for converting energy resulting from 
interaction between the object and said periodic pattern into 
an electrical signal, said electrical signal representing images 
,. ; of energy resulting from interaction between the object and 

said periodic pattern; and, 

a processor coupled to said periodic means and said second imaging 
system, said processor for controlling said periodic means in 
two dimensions, said processor for. extracting two 
dimensional information in phase with said periodic pattern 
and two dimensional information 90 degrees out of phase 
with said periodic pattern. 

13. The apparatus of claim 12 ? wherein said periodic means 
includes two gratings oriented 90 degrees apart. 

14. The apparatus of claim 12, wherein said processor causes 
said periodic means to move continuously whereby the phase of the 
illuminating periodic pattern falling on the object is varied continuously. 

15. The apparatus of claim 12, wherein said processor causes 
said periodic means to move in discrete steps whereby the phase of the 
illuminating periodic pattern falling on the object is varied in discrete 
steps. 
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21. The method. of claim 16; wherein said interaction of said 
. periodic illumination pattern with the object is phase shifting. 

22. The method of claim 16, wherein said interaction of said 
■ periodic illumination pattern with the object is absorption. 

23. The method of claim 16, wherein said interaction of said 
periodic illumination pattern with the object is fluorescence. 

24. The method of claim 16, wherein said interaction of said 
periodic illumination pattern with the object is depolarization. 

25. The method of claim 16, wherein said processing to produce 
' said synthetic image includes extracting information in phase with said 
. periodic illumination pattern. 

■26. The method of claim 16, wherein said processing to produce 
said synthetic image includes extracting information 90 degrees out of 
phase with said periodic illumination pattern. 

27. The method of claim 16, wherein said processing to produce 
said synthetic image includes measuring the phase of said optical image at 
the image plane. 

28. The method of claim 16, wherein said processing to produce 
said synthetic image includes measuring the amplitude of said optical 
image at the image plane. 

29. The method of claim 16, wherein said periodic illumination 
pattern is an image of a source pattern which has a periodic structure. 
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30. The method of claim 29, wherein said source pattern is an 
electronically controlled spatial filter. 

31. The method of claim 29, wherein said source pattern is an 
electronically controlled light source. 

32. The method of claim 16, wherein said periodic illumination 
pattern is an interference pattern of a plurality of coherent beams, thereby 
providing a coherent interference pattern. 

33. A method for producing three-dimensional information of a 
thick volume comprising the steps of; 

(a) individually illuminating thin slices of the thick volume with 
a periodic illumination pattern whereby each said slice * interacts with said 
periodic illumination pattern; 

(b) scanning each said slice with said periodic illumination pattern 
whereby the phase of said periodic illumination pattern of each said slice 
is varied; 

(c) providing an optical microscope for imaging said interaction 
of each said slice with said periodic illumination pattern, said imaging 
thereby producing optical images, said optical images representing said 
interaction of each said slice with said periodic illumination pattern; 

(d) producing a plurality of said optical images of each said slice 
with said optical microscope; 

'(e) providing a processor for mathematically processing said 
optical images of each said slice to produce synthetic images; and, 

(f) processing said optical images with said processor to produce 
a synthetic image of each said slice. 
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34. The method of claim 33, wherein said periodic illumination 
pattern is -tilted. 

35. A method for producing a synthetic image of an object 
comprising the steps of; 

(a) illuminating. the object with a periodic illumination pattern 
which is periodic in two dimensions, whereby the object interacts with said 
periodic illumination pattern; 

.(b) scanning the object in two axes with said periodic illumination 
pattern whereby the phase of said periodic illumination pattern is varied 
in said two axes; 

.(c) providing an optical microscope for imaging said interaction 
of the object with said periodic illumination pattern, said imaging thereby 
producing optical images, said optical images representing said interaction 
of the object with said periodic illumination pattern; 

(d) producing a plurality of said optical images with said optical 
microscope; 

(e) providing a processor for mathematically processing said 
optical images to produce a synthetic image; and, 

(f) processing said optical images with said processor to produce 
a synthetic image. 

36. The method of claim 35, wherein said periodic illumination 
pattern is tilted. 

37. The method of claim 35, wherein said interaction of said 
periodic illumination pattern with the object is scattering. 

38. The method of claim 35, wherein said interaction of said 
periodic illumination pattern with the object is reflection. 
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39. The method of claim '35, wherein said interaction of said 
periodic illumination pattern with the object is transmission. 

40. The method of claim 35, wherein said interaction of said 
periodic illumination pattern with the object is phase shifting. 

41. The method of claim 35,' wherein said interaction of said 
periodic illumination pattern with the object is absorption. 

42. The method of claim 35, wherein said interaction of said 
periodic illumination pattern with the object is fluorescence. 

43.. The method of claim 35, wherein said interaction of said 
periodic illumination pattern with the object is depolarization. 

44. The method of claim 35, wherein said processing to produce 
said synthetic image includes extracting information in phase with said 
periodic illumination pattern in both said axes. 

45. The method of claim 35, wherein said processing to produce 
said synthetic image includes extracting information 90 degrees out of 
phase with said periodic illumination pattern in both axes. 

46. The method of claim 35, wherein said processing to produce 
said synthetic image includes extracting information in phase with said 
periodic illumination pattern in one said axis and 90 degrees out of phase 
with said periodic illumination pattern in the second axis. 
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• 47. The method of claim 35, wherein said processing to produce 
said synthetic image includes measuring the phase of said optical image at 
the image plane. 

■ 48. The method. of claim 35, wherein said processing to produce 
said synthetic image includes measuring the amplitude of said optical 
. image at the image plane. 

49. The method of claim 35, wherein said periodic illumination 
pattern is an image of a source pattern which has a periodic structure. 

50. The method of claim 49, wherein said source pattern is an 
electronically controlled spatial filter. 

51. The method of claim 49, wherein said source pattern is an 
• electronically controlled light source. 

52. The method of claim 35, wherein said periodic illumination 
pattern is an interference pattern of a plurality of coherent beams, thereby 
providing a coherent interference pattern. 

.53. A method- of identifying the interaction of a periodic 
illumination pattern with an object within the focal range of a microscope, 
comprising the steps of: 

(a) producing illumination having a periodic illumination pattern 
within the focal range of the microscope; 

(b) imaging the object within the focal range with the microscope 
to produce an optical image, whereby the periodic pattern of the 
illumination modulates the optical image in space domain; and, 
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(c) measuring the amplitude of the modulation frequency in space 
domain within an area of interest of the optical, image. 

54. A method of identifying the interaction of a periodic 
illumination pattern with an object within the focal range of a microscope, 
comprising the steps of: 

(a) producing illumination having a periodic illumination pattern in 
space domain within the focal range of the microscope; 

(b) varying, in time, in a periodic manner, the phase of the 
periodic illumination pattern, thereby providing a periodic illumination 
both in space domain and in time domain;. . 

(c) imaging the object within the focal range with the microscope 
to produce an optical image, whereby the periodic pattern of the 
illumination modulates the optical image in both space domain and in time 
domain; and 

(d) measuring the amplitude of the modulation frequency in time 
domain within an area of interest of the optical image. 

55. A method of focussing a microscope, comprising the steps of: 

(a) producing illumination having, a periodic illumination pattern 
within the focal range of the microscope; 

(b) imaging the object within the focal range with the microscope 
to produce an optical image, whereby the periodic pattern of the 
illumination modulates* the optical image in space domain; and 

(c) measuring the amplitude of the modulation frequency in space 
domain within an area of interest of the optical image; 

(d) varying the focal range of the microscope; and 

(e) finding the focal range of the microscope at which the 
interaction of an object with said periodic illumination pattern is greatest. 
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56-. A method of focussing a microscope, comprising the steps of: 

(a) producing illumination having a periodic illumination pattern in 
space domain within the focal range of the microscope; 

(b) - -varying,- in time, in a periodic manner, the phase of the 
periodic illumination pattern, thereby providing a periodic illumination 
both in space domain and in time domain; 

(c) imaging the object within the focal range with the microscope 
to produce an optical image, whereby the periodic pattern of the 
illumination modulates the optical image in both space domain and in time 
domain; 

(d) measuring the amplitude of the modulation frequency in time 
domain within an area of interest of the optical image; 

(e) varying the focal range of the microscope; and 

■(f) finding the focal range of the microscope at which the 
interaction of an object with said periodic illumination pattern is greatest. 

57. A method of coupling a microscope to a second optical imaging 
system, comprising the steps of: 

(a) projecting a periodic illumination pattern with the second 
optical imaging system onto the image plane of the second optical imaging 
system; 

(b) imaging said periodic illumination pattern with the microscope 
to produce an optical image, whereby the periodic pattern of the 
illumination modulates the optical image in space domain; and 

(c) measuring the amplitude of the modulation frequency in space 
domain within an area of interest of the optical image; 

(d) varying the location of the said image plain of the said optical 
imaging system with respect to the said object plain of the said 
microscope, and 
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(e) finding the location of the said image plain of the said optical 
imaging system with respect to the- said object plain of the said 
microscope, at which the amplitude of the modulating frequency in space 
domain, at the area of interest. of the optical image, is highest. 

58. A method of coupling a microscope to a second optical imaging 
system, comprising the steps of: 

(a) producing illumination having a periodic illumination pattern in 
space domain within the focal range of the microscope; 

(b) varying, in time, in a periodic manner, the phase of the 
periodic illumination pattern, thereby providing a periodic illumination 
both in space domain and in time domain; 

(c) imaging said periodic illumination pattern with the microscope 
to produce an optical image, whereby the periodic pattern of the 
illumination modulates the optical image in both space domain and in time 
domain; 

(d) measuring the amplitude of the modulation frequency in time 
domain within an area of interest of the optical image; 

(e) varying the position of the image plain of the optical imaging 
system with respect to the object plain of the microscope; and, 

(0 finding the position of the image plain of the optical imaging 
system with respect to the object plain of the microscope, at which the 
amplitude of the modulating frequency in time domain, at the area of 
interest of the optical image, is highest. 

59. A method for three-dimensional imaging of an object, 
comprising the steps of: 

(a) illuminating the object with a tilted periodic illumination 
pattern, whereby said tilted illumination pattern creates a meshing effect 
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over the object, the shape of said meshing effect being a function of the 
topology of the object; : 

(b) ■ providing a microscope for imaging the object; 

(c) imaging the object to produce an optical image. 



WO 97/06509 



PCT/US96/12276 



1/3 

PERIODIC ILLUMINATION 




OBJECT 




CONVENTIONAL 
IMAGING 
SYSTEM 




PROCESSOR 


SYNTHETIC 






* IMAGE 



22 



10 



32 

FIG.l 



28 



14 




16- 




28 



36- 



PROCESSOR 



26- 



MOTOR 




30 



/ 



CAMERA 



T 



DISPLAY 



10' 



FIG.2 



WO 97/06509 



PCT/US96/I2276 



3/3 




PERIODIC 
PATTERN 
ILLUMINATION 



INTERN 



AJL SEARCH REPORT 



iternational application No. 
'PCT/US96/12276 



A. CLASSIFICATION OF SUBJECT MATTER 

IPC(6) :G06T5/0O 
US CL :382/254; 356/376 
According to International Patent Classification (IPC) or to both national classification and IPC 



B. FIELDS SEARCHED 



Minimum documentation searched (classification system followed by classification symbols) 
U.S. : 382/254, 299, 276; 356/376, 387 



Documentation searched other than minimum documentation to the extent that such documents are included in the fields searched 



Electronic data base consulted during the international search (name of data base and, where practicable, search terms used) 
APS, STN r ProQuest IEEE 

search terms; periodic, phase, increasing bandwidth 



DOCUMENTS CONSIDERED TO BE RELEVANT 



Category* 



Citation of document, with indication, where appropriate, of the relevant passages 



Relevant to claim No. 



Y 



Y,P 



US, A, 4,212,073 (BALASUBRAMANIAN) 08 July 1980, 
col. 2, lines 24-43 - 

US, A, 4,844,617; (KELDERMAN ET AL.) 04 July 1989, 
abstract 

US, A, 4,929,951 (SMALL) 29 May 1990, col. 2, lines 7-68, 
col. 3, lines 1-19 

US, A, 5,146,293 (MERCER ET AL.) 08 September 1992, 
col. 2, lines 41-68 

US, A, 5,381,236 (MORGAN) 10 January 1995, col.1, lines 
55-68, col. 2, lines 1-12 

US, A, 5,471,307 (KOUOPOULOS ET AL.) 28 November 
1995, col. 3, lines 53-68, col. 7, lines 44-58, col. 8, lines 25- 



1-59 



53-59 



1-59 



1-15, 26, 45- 
46, 

55-56 



1-59 



Further documents are listed in the continuation of Box C. See patent family annex. 



Special categories of cited documents: 

document defining the general uate of the an which u not considered 
to be part of particular relevance 

earlier document published on or after the international filing date 

document which may throw doubt* on priority claim(s) or which is 
cited to establish the publication dale of another citation or other 
apecial reason (as specified) 

document referring lo an oral disclosure, use. exhibition or other 



document published prior to the iniernauooal filing date but later then 
the priority date claimed ^ 



later document published after the international filing dale or priority 
date and not in conflict with the application but cited to understand the 
principle or theory underlying the invention 

document of particular relevance; the claimed invention cannot be 
considered novel or cannot be considered to involve an inventive step 
when the document is taken alone 

document of particular relevance; the claimed invention cannot be 
considered to involve an inventive step when the document is 
combined with one or more other such documents, such combination 
tyin g obvious to a person skilled in the art 

document member of the same patent family 



Date of the actual completion of the international search 



25 SEPTEMBER 1996 



Date of mailing of the international search report 




Name and mailing address of the ISA/US 
Commissioner of Patents and Trademarks 
Box PCT 

Washington, D.C. 20231 
Facsimile No. (703) 305-3230 



/JON CHANG 
Telephone No. (703) 305-8439 



Form PCT/ISA/210 (second sheet)(July 1992)* 



INTERACTIONAL SEARCH REPORT 



International application No. 
PCT/US96/ 12276 



C (Continuation). DOCUMENTS CONSIDERED TO BE RELEVANT 



Category* 


Citation of document, with indication, where appropriate, of the relevant passages 


Relevant to claim No. 


A 
A 


US, A, 4,164,788 (JAIN) 14 August 1979, abstract 

US, A, 5,156,943 (WHITNEY) 20 October 1992, abstract 


1-59 
1-59 



Form PCT/ISA/210 (continuation of second sheet)(July 1992)* 



